Web Survey Bibliography
Title The impact on interviewee behavior caused by audiovisual online-communication answering sensitive questions
Author Muehlenfeld, H.-U.
Year 2004
Access date 11.05.2004
Abstract Research findings show that sensitive questions and especially questions about sexual behaviour provoke a) the tendency to give a socially desirable answer and b) variances between more or less anonymous interview modes. The paper investigates the tendency to give socially desirable answers between three interview modes: a Computer Assisted Personal Interview (CAPI), a web-based questionnaire (ONLINE) and an innovative method called Internet Assited Personal Interview (IAPI), using a desktop video conference system to facilitate communication between the interviewer and the interviewee. All three methods differ in anonymity, whereas the CAPI is the the least anonymous interview situation and the ONLINE most anonymous. Consequently, the interviewee's reaction to highly sensitive questions, e.g. questions about sexual behaviour, should differ. An experimental study was performed in may 2003 in order to investigate this thesis. 90 psychology students of the University of Bremen (75 female, 15 male) were randomly assigned to one of the methods. Decisive socio-demographic parameters did not differ significantly between the groups and all participants were asked the same questions, which means that the internal validity of the experiment was given. Consequently, differences of the results can be seen as an impact of the methode. In order to get an even more intense contrast extremely sensitive items, e.g. questions about sexual behavior or drug use, were used. Additionally, social desirability scales (the SES-17 from Stöber 1999 and the German version of the BIDR from Musch, Brockhaus and Bröder 2002) were applied. Results show very little differences and not all items are in compliance with the assumptions of the study. This might be provoked through the homogeneity of the population and of another, more interesting aspect. All the interviewees seemed to be very honest. And it also seemed that sometimes the conversational coercions posed by the presence of an interviewee overrided the anonymity aspect. Which means, that the more anonymous settings, like the web-based questionnaire or the IAPI invited more interviewees to 'hide' the truth than to report it, since there was nobody they actually (vs. virtually) were obliged to be honest to.
Abstract - optional Untersuchungen haben gezeigt, dass das Fragen von sogenannten 'peinlichen' oder 'unangenehmen' Fragen innerhalb von Befragungen die Versuchspersonen veranlassen, a) sozial erwünscht zu antworten und b) Unterschiede zwischen dem Antwortverhalten besteht, je anonymer das Interviewsetting ist. Der Vortrag stellt den Vergleich von drei Befragungsmethoden in Bezug auf deren Einfluss auf die Tendenz, sozial erwünscht zu antworten, dar. Dabei werden drei Methoden, CAPI, ONLINE (web-basierter Fragebogen) und IAPI (Internet Assisted Personal Interview) verglichen. Beim IAPI handelt es sich um eine innovative Online-Befragungsmethode, bei der zur Herstellung der Kommunikationssituation ein Desktop-Videokonferenzsystem eingesetzt wird, so dass der Interviewer und der Interviewte sich in Echtzeit sehen und hören können. Die drei Methoden unterscheiden sich in ihrem Grad an Anonymität, weshalb davon auszugehen ist, dass sich das Antwortverhalten, induziert durch die unterschiedlichen Methoden, unterscheidet. Um den Einfluss der Methode, insb. des noch nicht etablierten IAPI zu analysieren, wurde im Mai 2003 an der Universität Bremen ein Experiment mit insgesamt 90 Psychologiestudierenden durchgeführt. (75 weiblich), 15 männlich). Die Versuchspersonen, die sich in Bezug auf einschlägige soziodemografische Merkmale nicht unterschieden, wurden randomisiert auf die drei Methoden verteilt. Allen drei Befragtengruppen wurden dieselben Items präsentiert, so dass die interne Validität des Experiments gegeben ist. Folglich müssen jeweils auftretende Unterschiede durch den Einfluss der Methoden bedingt sein. Um einen möglichst großen Kontrast zu bekommen, wurden u.a. Fragen gestellt, die einen sehr hohen Grad an Peinlichkeit aufwiesen, wie z.B. Fragen zum Sexualverhalten oder Drogenkonsum. Zusätzlich wurden Sozialerwünschtheitsskalen, namentlich die SES-17 von Stöber (1999) und die deutsche Version des BIDR von Musch, Brockhaus und Brödeer (2002), mitlaufen gelassen. Die Ergebnisse zeigen nur geringe unterschiede, was auf die Homogenität der Untersuchungspopulation zurückgeführt werden muss. Darüber hinaus sind einige der Items nicht konsistent, so dass sie zu den gestellten Annahmen passen würden. Allerdings ergab sich ein Phänomen, welches ebenfalls zu den geringen Differenzen beitrug, aber so nicht vorhersehbar war. Alle Befragten schienen sehr ehrlich zu sein. Und diese Ehrlichkeit wurde durch die Gesprächszwänge, die eine Face-to-Face Konversation mit sich bringt, noch verstärkt, so dass bei einigen sehr peinlichen Fragen die meisten Angaben in der Interviewsituation gemacht, die die geringste Anonymität aufwies. Anscheinend fällt es einfacher, die Wahrheit nicht Preis zu geben, wenn die (Ver-)Bindung schwächer ist.
Access/Direct link Homepage - conference (abstract)
Year of publication2004
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Germany (361)
- Interviewer effects on onliner and offliner participation in the German Internet Panel; 2017; Herzing, J. M. E.; Blom, A. G.; Meuleman, B.
- Comparing the same Questionnaire between five Online Panels: A Study of the Effect of Recruitment Strategy...; 2017; Schnell, R.; Panreck, L.
- Push2web or less is more? Experimental evidence from a mixed-mode population survey at the community...; 2017; Neumann, R.; Haeder, M.; Brust, O.; Dittrich, E.; von Hermanni, H.
- Social Desirability and Undesirability Effects on Survey Response latencies; 2017; Andersen, H.; Mayerl, J.
- Comparison of response patterns in different survey designs: a longitudinal panel with mixed-mode and...; 2017; Ruebsamen, N.; Akmatov, M. K.; Castell, S.; Karch, A.; Mikolajczyk, R. T.
- Mobile Research im Kontext der digitalen Transformation; 2017; Friedrich-Freksa, M.
- Kognitives Pretesting; 2017; Neuert, C.
- Grundzüge des Datenschutzrechts und aktuelle Datenschutzprobleme in der Markt- und Sozialforschung; 2017; Schweizer, A.
- Article Establishing an Open Probability-Based Mixed-Mode Panel of the General Population in Germany...; 2017; Bosnjak, M.; Dannwolf, T.; Enderle, T.; Schaurer, I.; Struminskaya, B.; Tanner, A.; Weyandt, K.
- Socially Desirable Responding in Web-Based Questionnaires: A Meta-Analytic Review of the Candor Hypothesis...; 2016; Gnambs, T.; Kaspar, K.
- Methodological Aspects of Central Left-Right Scale Placement in a Cross-national Perspective; 2016; Scholz, E.; Zuell, C.
- Predicting and Preventing Break-Offs in Web Surveys; 2016; Mittereder, F.
- Incorporating eye tracking into cognitive interviewing to pretest survey questions; 2016; Neuert, C.; Lenzner, T.
- Geht’s auch mit der Maus? – Eine Methodenstudie zu Online-Befragungen in der Jugendforschung...; 2016; Heim, R.; Konowalczyk, S.; Grgic, M.; Seyda, M.; Burrmann, U.; Rauschenbach, T.
- Comparing Cognitive Interviewing and Online Probing: Do They Find Similar Results?; 2016; Meitinger, K., Behr, D.
- Device Effects - How different screen sizes affect answers in online surveys; 2016; Fisher, B.; Bernet, F.
- Effects of motivating question types with graphical support in multi channel design studies; 2016; Luetters, H.; Friedrich-Freksa, M.; Vitt, SGoldstein, D. G.
- Analyzing Cognitive Burden of Survey Questions with Paradata: A Web Survey Experiment; 2016; Hoehne, J. K.; Schlosser, S.; Krebs, D.
- Secondary Respondent Consent in the German Family Panel; 2016; Schmiedeberg, C.; Castiglioni, L.; Schroeder, J.
- Does Changing Monetary Incentive Schemes in Panel Studies Affect Cooperation? A Quasi-experiment on...; 2016; Schaurer, I.; Bosnjak, M.
- Using Cash Incentives to Help Recruitment in a Probability Based Web Panel: The Effects on Sign Up Rates...; 2016; Krieger, U.
- The Mobile Web Only Population: Socio-demographic Characteristics and Potential Bias ; 2016; Fuchs, M.; Metzler, A.
- The Impact of Scale Direction, Alignment and Length on Responses to Rating Scale Questions in a Web...; 2016; Keusch, F.; Liu, M.; Yan, T.
- Web Surveys Versus Other Survey Modes: An Updated Meta-analysis Comparing Response Rates ; 2016; Wengrzik, J.; Bosnjak, M.; Lozar Manfreda, K.
- Retrospective Measurement of Students’ Extracurricular Activities with a Self-administered Calendar...; 2016; Furthmueller, P.
- Privacy Concerns in Responses to Sensitive Questions. A Survey Experiment on the Influence of Numeric...; 2016; Bader, F., Bauer, J., Kroher, M., Riordan, P.
- Ballpoint Pens as Incentives with Mail Questionnaires – Results of a Survey Experiment; 2016; Heise, M.
- Does survey mode matter for studying electoral behaviour? Evidence from the 2009 German Longitudinal...; 2016; Bytzek, E.; Bieber, I. E.
- Forecasting proportional representation elections from non-representative expectation surveys; 2016; Graefe, A.
- Setting Up an Online Panel Representative of the General Population The German Internet Panel; 2016; Blom, A. G.; Gathmann, C.; Krieger, U.
- Online Surveys are Mixed-Device Surveys. Issues Associated with the Use of Different (Mobile) Devices...; 2016; Toepoel, V.; Lugtig, P. J.
- Stable Relationships, Stable Participation? The Effects of Partnership Dissolution and Changes in Relationship...; 2016; Mueller, B.; Castiglioni, L.
- Will They Stay or Will They Go? Personality Predictors of Dropout in Online Study; 2016; Nestler, S.; Thielsch, M.; Vasilev, E.; Back, M.
- Respondent Conditioning in Online Panel Surveys: Results of Two Field Experiments; 2016; Struminskaya, B.
- A Privacy-Friendly Method to Reward Participants of Online-Surveys; 2015; Herfert, M.; Lange, B.; Selzer, A.; Waldmann, U.
- The impact of frequency rating scale formats on the measurement of latent variables in web surveys -...; 2015; Menold, N.; Kemper, C. J.
- Investigating response order effects in web surveys using eye tracking; 2015; Karem Hoehne, J.; Lenzner, T.
- Implementation of the forced answering option within online surveys: Do higher item response rates come...; 2015; Decieux, J. P.; Mergener, A.; Neufang, K.; Sischka, P.
- Translating Answers to Open-ended Survey Questions in Cross-cultural Research: A Case Study on the Interplay...; 2015; Behr, D.
- The Effects of Questionnaire Completion Using Mobile Devices on Data Quality. Evidence from a Probability...; 2015; Bosnjak, M.; Struminskaya, B.; Weyandt, K.
- Are they willing to use the web? First results of a possible switch from PAPI to CAPI/CAWI in an establishment...; 2015; Ellguth, P.; Kohaut, S.
- Measuring Political Knowledge in Web-Based Surveys: An Experimental Validation of Visual Versus Verbal...; 2015; Munzert, S.; Selb, P.
- Changing from CAPI to CAWI in an ongoing household panel - experiences from the German Socio-Economic...; 2015; Schupp, J.; Sassenroth, D.
- Rating Scales in Web Surveys: A Test of New Drag-and-Drop Rating Procedures; 2015; Kunz, T.
- Mode System Effects in an Online Panel Study: Comparing a Probability-based Online Panel with two Face...; 2015; Struminskaya, B.; De Leeuw, E. D.; Kaczmirek, L.
- Higher response rates at the expense of validity? Consequences of the implementation of the ‘forced...; 2015; Decieux, J. P.; Mergener, A.; Neufang, K.; Sischka, P.
- A quasi-experiment on effects of prepaid versus promised incentives on participation in a probability...; 2015; Schaurer, I.; Bosnjak, M.
- Response Effects of Prenotification, Prepaid Cash, Prepaid Vouchers, and Postpaid Vouchers: An Experimental...; 2015; van Veen, F.; Goeritz, A.; Sattler, S.
- Recruiting Respondents for a Mobile Phone Panel: The Impact of Recruitment Question Wording on Cooperation...; 2015; Busse, B.; Fuchs, M.
- The Influence of the Answer Box Size on Item Nonresponse to Open-Ended Questions in a Web Survey ; 2015; Zuell, C.; Menold, N.; Koerber, S.